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Abstract — As a powerful high resolution image modeling 
technique, compressive sensing (CS) has been successfully 
applied in digital image processing and various image 
applications. This paper proposes a new method of efficient 
image reconstruction based on the Modified Frame 
Reconstruction Iterative Thresholding Algorithm (MFR ITA) 
developed under the compressed sensing (CS) domain by using 
total variation algorithm. The new framework is consisted of 
three phases. Firstly, the input images are processed by the 
multilook processing with their sparse coefficients using the 
Discrete Wavelet Transform (DWT) method. Secondly, the 
measurements are obtained from sparse coefficient by using the 
proposed fusion method to achieve the balance resolution of the 
pixels. Finally, the fast CS method based on the MFR ITA is 
proposed to reconstruct the high resolution image. 

Index Terms — Sensing, Image Reconstruction, Multilook, 
MFRITA, Thresholding 


I. Introduction 

High Resolution image is consider to be a major 
component in digital imaging, and achieving a good contrast 
and better resolution remain a critical issues. Therefore to 
overcome this problem several methods have been proposed. 
In general a possible way to achieve this goal is by using 
image fusion methods. If we considering about image 
compression methodology in image processing, the new 
techniques which embark the great result and received great 
deal of attention of the researcher called compressed sensing 
[1-2], and requires the less amount of linear projections from 
the required samples comparatively with the nyquist rate and 
this method would drastically reduce computational cost and 
storage space without obtaining the whole image information. 

In past several a method has proposed based on pixel based 

[3] , the method was very unique but operated on every pixels 
consumed large processing and the cost would be increased. 
The image fusion method has been used based on the 
compressed sensing (CS) method [4-6] and fused 
measurement through maximum selection (MS) [7]. Lately 
the CS has been most valuable method that can recovers the 
signals which are sparse or compressible based on some 
linear measurement matrix other than the traditional Nyquist 
method. The CS has been used to achieve accurate signal 
reconstruction while sampling a signal at low sampling rate, 
and it was much smaller than the traditional Nyquist theorem 

[4] . 

Recently the new methodology, the dual pulse coupled 
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neural network (DPCCN), using multi focus scheme based on 
the CS concept [6], has been incorporated into the fusion 
measurement by defining weighting factor produced good 
efficiency of reconstruction of image, but it has required large 
space and processing time to get this conversion. Some 
methods fuse the measurement of the sparse signal and then 
processed based on the CS, this method was required long 
computational processing time [8]. The multi-focus image 
method was the efficient method related to the image fusion 
using the weighted function has been done in previous works 
[6] . It has shown that the results have been recovered image 
but required large computational cost and time. Some of the 
reconstructions of image were required large mathematical 
calculations by fusing the measurement matrix. Developed 
the algorithms which can solve the LI minimization problem 
has been applied successfully to many applications such as 
biomedical, image and signal processing. However this 
methodology achieved a great success of sparse signal but has 
fewer artefacts to overcome this problem of the Augemented 
Lagrangian Method (ALM), which was efficient method to 
resolve the minimization problem but it has some limitation 
because of low convergence rate [9] . Many traditional image 
reconstruction algorithms based on the fusion method to 
reconstruct an image have been applied to section of the 
images recently [4-6]. These methods included the pyramid 
based method [10], and discrete wavelet transform [11] etc. 
In practice the DWT methodology is the robust method than 
the pyramid method, but there is some disadvantages if we 
applied the DWT method directly, it would not provide the 
optimal solution such as, reduced brightness, contrast, and 
noise. 

In this paper we proposes an image reconstruction by using 
the CS based on the modified frame reconstruction iterative 
thresholding algorithm (MFR ITA), the input images are 
process by using multi look processing to minimizes the noise 
present in image prior to discretizes by the DWT to achieve 
the better contrast of the image, then the measurement are 
obtained by defining measurement matrix and fused by 
proposed method to recover the sparse coefficients from the 
fused measurements. The last contribution of this paper lies 
by applying measurement in the CS domain based on MFR 
ITA by updating and thresholding to achieve the optimum 
solution of the recovery of sparse signal, and to reconstruct 
the high resolution image by applying the total variation 
(TV). The simulation results have shown good improvements 
by comparing PNSR, and SSIM values of proposed method 
with other traditional methods namely as, OMP, Min TV. In 
addition the validity of proposed method, by comparing the 
reconstruction of SNR in the presence of multiple noise with 
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iterative hard thresholding (IHT) and, the probability of 
recovered signal by fixing the number of measurements to 
150, therefore achieve an enhanced reconstruction quality 
images by using the proposed method. 

The paper is organized as follows. In Section 2 we 
discussed the problem formulation and modeling by 
introducing Multilook and Modified Frame Reconstruction 
IT A methods. The compressive image fusion and Total 
Variation methods are introduced in Section 3. In Section 4 
presents the error analysis and performance of MFR ITA. The 
simulations results are given in Section 5. Finally, Section 6 
concludes this paper. 

II. Problem Formulation and Modeling 

As illustrated in the introduction section, the most 
significant issue which is associated with HR imaging for 
reconstruction of high resolution image is poor contrast and, 
blurriness at output when the resolution of input image is low. 
The structure of the proposed method is shown in Fig. 1 in the 
form of block diagram to clarify the above statement. This 
method consists of three parts sampling of image, then 
measurement approximations and finally image 
reconstruction. Firstly, the input image Xi is divided into nxn 
segments. Then these segments are processed by the look 
formation and its output is sampled by measurement 
matrix [0] with the size of MXN, and assuming that M<N. 
Secondly, the sampled result are fused to construct Y by using 
the fusion scheme under measurement domain. Finally, this 
complete measurements Y is processed by MFR ITA to 
achieve high resolution image by defining the updating and 
thresolding under CS domain. 

A. Multilook and Compressed Sensing 
Compressed sensing has shown that the sparse or 
compressible can be done by using low rate acquisition 
process [12]. The multilook processing is widely used to 
reduce speckle method in the image processing and the SAR 
imaging [13], and it is summing of the input images such as 
sub images. 

[Y] = [0][Y] (1) 

where the matrix [X] stands for the input images, [Y] is 
output image, and [0] is the sampling coefficient matrix of the 
measurement. 

Sampled results need to convert into the complete 
measurement based on fusion method. The proposed image 
reconstruction based on the CS with one dimensional length 

finite length signal x * G R ' v can be expressed as vector 
forms. 

x i ~ c i <Pi ( 2 ) 

K K 

X - ( 3 J 

l = i l =: 

where cpi is expressed the orthonormal basis matrix and C; is 


the sparse coefficients. The input image X is with K sparse 
representation, K < N. We define that Y C R M is the 
measurement and 0 is the M*N sampling matrix then, 

Yi = (43 

V = y} =1 y< = (S3 

The matrix form can be expressed as, 

[Y] = [»][+] (6j 

where the matrix [0] size is M*N. 

Because the measurement process is not adaptive, it means 
that if 0i is fixed and it does not depend on the reconstructed 
signal xi. When M < N, recovering X from the measurement 
Y becomes the linear problem [14-15], yet the original signal 
is reconstructed it can be recovered perfectly by using 
optimization procedures. 

e 



Fig. 1 : Block Diagram of Proposed Method. 


Without loss generality, we consider the input images are 
XI and X2 Fig. 1 is the block diagram of proposed method of 
reconstruction of high resolution images. XI and X2 are 
processed by look formation in the sub images forms under 
multilook domain, so that the fusion method processes each 
of input images. Once the sampled results are obtained, then 
the sampled results Y 1 and Y2 are fused in to a complete set 
of measurement Y. Finally, we process the complete 
measurement with the CS, based on modified frame 
reconstruction (MFR) ITA by updating and thresholding to 
achieve the high resolution image using total variation (TV). 

B. Modified Frame Reconstruction ITA 
The iterative threshold is very simple iterative procedure 
with some general definition. For a signal xi, the iterative of 
the starting signal can be expressed as follows [16-17], 
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= 0 

xf = H (if) 


(?) 


where ^ is the nonlinear operator that set the largest we 
adopt MFR IT A technology, which is the frame 
reconstruction algorithm and is dependent on the steps length. 

; ra-l 

i is a variable determined by signal, and residual and 
thresholding. 

The MFR IT A has shown great modifications both of 
increases of convergence and success rate to recover the 
original sparse signal to from the general definition. It 
involves two steps, 1) update and 2) thresholding. The 
iteration used to extract the useful information from residual 
and thresholding will suppress the alias effect and gives the 
sparsity of the signal. 

hf +1 = xf -f ~ (Sj 

where yi is the vector of the measurement and 0i is the 
measurement matrix parameters which controls the rate of 
convergence of the iteration, as we need to recover the sparse 
signal. 

The MFR IT A algorithm is very efficient and simple 
method which provides intuitive solution and it is based on 
the operator 0i in each iteration. Eq. (8) is the updating form, 

n + l 

variable i is the updating parameter of each frame, we 

introduce an adjustable factor 1 '' '- a ^0, where a and 

b are image frame bounds for s sparse vectors. From Eq. (7), 
the sparse vectors can be recovered. 

*P +1 = H[bf + 1 ] =H[x* + - G : ,rf;;i] (9j 

Eq. (9) is the thresholding form in each step of frame based 

on 1 ' iteration and it selects the largest of the magnitudes and 
preserves all components. 


IE. Image Reconstruction 

Image reconstruction play an important role in biomedical 
imaging, digital image processing and many others 
applications. Compressed Sensing (CS) is an efficient 
method which is fast and highly reliable recovery algorithm 
[4]. In this section, we discussed the image fusion based on 
the CS concept. 


A. Proposed Compressive Image Fusion 
In previous work, although the wavelet based method was 
used as an effective fusion way for fusion images, there were 
still some problems exist because the using of the high and 
low frequency have quite different in certain aspects. In the 
CS domain, it only needs to consider compressive 
measurement [4]. Studies have shown the traditional fusion 
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scheme cannot be applied to the CS domain because of low 
spatial process, and it is used if the signal is sparse in some 
basis, likewise its measurement encodes the salient 
information of it [4]. The fusion scheme have maximum of 
absolute values (MAV) which is used widely in the wavelet 
domain [18], and the standard deviation (SD) of the 
measurement sampling in the CS domain is used to balance 
the contrast and minimizes the blurriness of the output 
image. The SD is commonly method is used to evaluate the 
amount information contained in the different form of the 
signal, and the SD of the image pixel information is given by 
below under the CS domain. 


re -1 re -1 

1 v- 


= | > > (X t ;-X) 

. 71 X 71 Z-i Z-i -• J ' 


i=0 ;=C 


( 10 ) 


X = 


1 

nX n 


Zji = C 




( 11 ) 


Y ■ ■ j Vfl ith 

where V is the pixel in L and * column of nxn image 


xi. 


We introduced the weighting fusion based on the SD 
measurement of input images. The larger the SD has 
contained more useful information and dispersed gray scale. 
It is needed to convert the standard deviation to the fused 
measurement, suppose Y is the fuse measurement, it can be 
written as follow, 


Y = + (12) 




where wl and w2 are weighting factors, which are key 
factors for the fuse measurement. Once the measurements are 
obtained, it can be applied in the CS based on the MFR ITA, 
we determine the update and thresholding for the recovery of 
the sparse signal, then using minimum total variation TV 
(Min-TV) algorithm to reconstruct the Images. 

IV. Simulation Results 

To analyze the performance behavior of CS based on the 
MFR ITA recovery method on the image, the image has been 

treated as vectorization into a n ~ x 1 column vector, the 
y c p/tf 

measurement is 1 - n and the dimension of the 
measurement matrix is 0i. The PNSRs comparisons of 
traditional methods likewise the OMP, the Min TV and the 
Min TV (MFR ITA), the quality of reconstructed image is 
increases as increasing the iterations and get the better PNSR. 
In Fig. 2 the various experiments have been done to evaluate 
the performance and it has been shown that the Min TV 
(MFR ITA) yields much better performance of recovering the 
original signals comparatively with traditional methods 
likewise the OMP and the Min TV which are not robust. The 
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PNSRs is better as increasing of the number of iterations. The 
measurement M/n2 is taken along the x-axes it is basically the 
rate of CS measurement converge with the MFR ITA over the 
original sparse signal, as we examined that reconstruction 
process consume sufficient computational time by using the 
proposed method because of the propose method. 

Fig. 2(a) - (c) are shown the image restoration results 
illustrating the convergence speed and PNSRs of the different 
methods. It is found that the result of the Min TV (MFR ITA) 
has achieved good PNSR and faster convergence, as 
compared to the OMP and the Min TV methods from the 
evaluation of the PNSRs. For 50 iterations, the PNSR is 
better and the MFR ITA method has good results 
comparatively with others methods as increasing to 100 and 
200 iterations of the MFR ITA, the PNSR is shown good 
result and achieved better reconstruction of image. The 
graphical representation would show better enhancement of 
images that can get by taking more measurements, but the 
objectives to recover the better quality images by using the 
proposed MFR ITA method. 
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Fig. 2: PNSRs of Reconstruction of image with different 
iterations for different iterations, (a) 200, (b) 100, (c) 50. 

Fig. 3 is the average PNSR comparison of proposed 
method with others traditional methods. It is sampled the 
value of each iterations likewise 50, 100 and 200, 
respectively, of three methods, the proposed method has a 
good PNSR compared with other traditional methods. Thus it 
is recovered the better resolution reconstructed image and 
achieved the fastest convergence rate of the MFR ITA 
compared with the OMP and the Min TV. 



Fig. 3: Average PNSR of Reconstruction of images. 


Table 1 is listed the average PNSR value verify the 
robustness and effectiveness of the Min TV (MFR ITA). It is 
clear that the proposed method display good PNSR and better 
reconstruction of image, and when the values of the 
measurement are increased the PNSR of the proposed method 
also are increased. 


TABLE 1: Comparison of average PNSR 


Measurement 
s (m/n2) 

OMP(dB) 

Min TV (dB) 

Min TV 
(MFR ITA) 
(dB) 

0.1 

9.3 

16.3 

27.4 

0.2 

14.3 

24 

30 

0.3 

18.3 

27 

33.6 

0.4 

21.4 

29.3 

36.6 

0.5 

24.4 

34 

40 

0.6 

26.6 

36 

43 


In order to evaluate the performance of proposed method, it 
can use efficient techniques to analysis the measure the 
quality of the reconstructed image [21] for the original and 
reconstructed image. 


error = 


IWI 2 


( 28 ) 


Fig. 4 is the comparison of the reconstruction errors of the 
proposed method and two others methods, the OMP and the 
improved OMP. The graphical represents highlighted that the 
three methods can reconstruct image with the certain 
measurements times. It is found that the reconstruction errors 
of the OMP and the improved OMP have slight differences 
because of the measurement time of the reconstruction image. 
The reconstruction error of the proposed based on MFR ITA 
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shows minimized compared with two traditional methods, 
and it can recover the most information using our proposed 
method. 
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Fig. 4: Errors Behaviour of Reconstruction. 


TABLE 3: SSIM Comparisons of Proposed method 


Image 

OMP Method 

Improved 

OMP 

Proposed 

Method 

Cameraman 

0.802 

0.812 

0.825 

Lena 

0.792 

0.819 

0.841 

Peppers 

0.765 

0.794 

0.822 

Boat 

0.762 

0.792 

0.826 


Fig. 6 shows the comparison of the SSIM values with 
different scheme by implementing on four test images 
(Cameraman, Lena, Peppers, and Boat). The average SSIM 
value in Table 3 from Fig. 6, and the objective assessment in 
terms of SSIM values, demonstrate that the proposed method 
achieved good reconstruction quality of image based on 
different iterations, and outperforms several competent 
method. 
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Fig. 8: Probability of Successfully Recovered Signal. 


V. Conclusions 

In this paper, we have proposed a new reconstruction 
method MFR ITA based on the CS as compare with the 
conventional OMP method. The proposed method is based on 
CS algorithm by defining updating and thresholding 
mechanism of MFR ITA scheme. A fusion scheme based on 
SD of the measurement has been introduced to fusing the 
image in CS domain to achieve and get the balance resolution 
of the pixels and then apply Min-TV optimization to 
reconstruct the high resolution images based on MFR ITA. 
The Simulation results and SSIM values demonstrated that 
MFR ITA yield a better reconstruction of image, the image 
resolution and quality increases as we increases the number 
of iterations, and achieved better PNSR and SSIM values 
compared with other traditional methods namely as, OMP 
and Min TV methods. Furthermore to demonstrate the 
performance of the proposed method firstly, we have done the 
reconstruction SNR in the presence of noise value and 
compared with the traditional IHT method secondly, the 
probability of successfully recovered signal has been done. It 
has shown that the proposed methods achieves a better 
improvements, and outperforms several other methods and, 
which also provides good reconstruction efficiency. 
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Fig. 7: Performance of MFR ITA in terms of noise values. 


The performance of the successful recovered signal are 
demonstrated in Fig. 8, the graph plot between the number of 
measurements and PNSR, to measure the probability of 
recovered signal, we assume some parameters, the length of 
the signal is 1000 and the sparsity signal is fixed at 150 the 
accuracy of the reconstruction growing with the knowing 
number of measurements, it also seems that reduces the 
number of measurements required to perfectly recovered the 
signal. 
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